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@ Post processing method and apparatus symbol reliability generation. 

@ A method is disclosed for a post-processor 
for providing reliabSity infonnatk>n about every 
decoded data symtKd at the output of an arbit- 
rary decoder. This ratability inforn)ation is gen- 
erated by comparing the decoded sequence to 
a small list of alternative sequences which differ 
from the decoded sequence at least in the 
symbol for which the reliabflity is being 
evaluated. It is shown that thisr^ algorithm Is a 
simplification of the optimal symbol-by-symbol 
detector (OSSD). 
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Technical Field 



This invention is a method and apparatus for post-processoring to provide reliability information for de- 
coded data symbols at the output of a decoder. 
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Background of the invention 

The Viterbi algorithm (VA) is well l<nown as an efficient maximum lilcelihood (ML) sequence estimator of 
data encoded by a finite state machine and conrupted by white noise. See, G.D. Forney Jr., "The Viterbi Algo- 
rithm," Proc, IEEE, vol. 61 , no. 3, pp. 268-278, Mar. 1 973. In many applications, the output of the Viterbi decoder 
is further processed by a second decoder in a concatenated coding system. FIG. 1 shows a concatenated cod- 
ing system in which outer encoder 121 transforms an information sequence a(A) into sequence b{k), inner en- 
coder 1 23 further encodes sequence b(k) to produce a sequence to be transmitted. Inner decoder 125 decodes 
the received sequence /J/c) to produce an estimate b{k) of the sequence encoded by inner encoder 123. Outer 
decoder 127 then uses b(ki to generate an estimate a{k) of the information sequence. Table 1 lists four exam- 
ples of specific coder combinations typical for the concatenated system of FIG. 1 . in all of these, the optimal 
decoder should operate on the joint state space of the outer and the inner code to obtain an estimate of the 
information sequence. However, in the first coding combination, i.e. the combined speech and channel coding 
scheme, of Table 1 , it is not yet known how to describe such a decoder. In the other three cases, such a decoder 
may be too complex to implement espedally when powerful codes are used for inner and outer codes. Hence 
a practical approach is to first perform the decoding of the received data by the inner decoder followed by outer 
decoding. 



Table 1 
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Emor Detection Encoder 
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Viterbi Decoder 
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Convolutional Encoder 


iSI Channel Channel 


Viterbi Equalizer 


Viterbi Decoder 
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Reed-Sdomon Encoder 


Convolutional Encoder 


Viterbi Decoder 


Errors and Erasures Decoder 



Typically, the inner decoder produces burst enrors. if the outer code is a random error correcting code, then 
an interleaver/deinterieaver pair 222,226 as illustrated in FIG. 2 may be inserted in the coding system of FIG. 
1. The pair will help to pseudo-randomtze the burst of errors so as to fedlitate the outer decoding process. If 
the outer code/intefleaverAinner code combinatfon is thought of as a new code, then its optimal decoder, which 
requires exhaustive search. Is even more difficult to implement 

Several techniques have been developed to improve the performance of concatenated coding systems. 
One such technique is the generalized Viterbi algorithm (GVA), See T. Hashimoto, "A Ust-Type Reduced-Con- 
straint Generalization of the Viterbi Algorithm," IEEE Trans, Inf. Theory, iT-33. pp. 866-876, Nov. 1 987; N. Se- 
shadri and C-E. W, Sundberg, "Generalized Viterbi Algorithms for Error Detedton With Convolutional Codes." 
In Proc. GLOBECOM'89, Dallas, Texas, pp. 1534-1538, Nov. 1989. The GVA generates a list of the L > 1 best 
estimates (also called candidate sequences) of b{k) at the inner decoder output according to a metric that de- 
scribes the inner channel. Each of these candidate sequences is decoded by the outer decoder according to 
a metric that best describes the outer channel. The best of the L decoded candidate sequences is selected as 
the final estimate of the infonmation sequence. For example, in a combined speech and channel coding system 
of Table 1, the metric for decoding the outer code may make use of speech based properties such as pitch 
information, spedral information, and Inter-f ranrie correlation in order to seled the of the L candidate sequenc- 
es from the inner decoder, in the second case in Table 1, the outer decoder chooses the candidate with zero 
syndrome from the L best candidate sequences that are released by the inner decoder. See Seshadri and Su nd- 
berg, supra. 

Alternatively, soft (symbd)-output Vitertji algorithms (SOVAs) have been proposed to replace the VA at 
the inner decoding stage. See G. Batteil. "Weighting the Symbds Decoded by the Viterbi Algorithm,">\/>sfracfs 
of the IEEE Int Symp, Inf. Theory, Ann Arbor, California, p. 141. Oct 1986; J. Hagenauer and P. Hoeher, "A 
Viterbi Algorithm With Soft-Dedston Outputs and Its Applications," Proc. GLOBECOM'89, Dallas, Texas, pp. 
1680-1686. Nov. 1989; J. Huberand Rueppel, "Reliability-Estimation for Symbds Deteded by Trellis-Decod- 
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ers," (in German), AEU, vol. 44, pp. 8-21, Jan. 1990. In the SOVA, the inner decoder releases the best path 
estimate at the output of the inner decoder along with the reliability infbnmation about each symbol in the se- 
quence decoded by the inner decoder. The outer decoder then uses the reliability information in soft-decoding 
the output sequence of the inner decoder. Maximum a posteriori symbol-by-symbol detection techniques (also 
known as optimal symbol-by-symtx}l detection techniques) can also be used. However, their complexity is 
much higher than soft-output Viterbi algorithms. 

The soft-output techniques for post-decision reliability generation sufferfrom shortcomings. First the best 
data sequence clearly passes through only one state in the Viterbi decoding trellis at every time instant, and 
these decisions are available with a certain delay. Hence, if one introduces a delay in computing the soft- 
outputs, then the decoded symt>ols are available and the reliability needs to be computed only for those sym- 
bols. However, the SOVA evaluates a reliability value at the same time as the data is being decoded and thus 
has to compute a reliability value for each state at each time. Two step algorithms" are more computationally 
efficient, but their drawback is the annount of memory required - typically, about 50% of the area of an integrated 
circuit designed to Implement the method is consumed by the additional delay units needed to store metric 
differences. See J. Hagenauer, P. Hoeher, and J. Huber, "Soft-Output Viterbi and Symbd-by-Symbol MAP De- 
coding: Algorithms and Applications," submitted to fEEE Trans. Comm.: O. Jorgensen, M. Vaupej, and H. Meyr, 
"High-Speed VLSI Architectures for Soft-Output Vifert)i Decoding," Proc. InL Conf. App/. Specif ic Array Proc- 
essors (ASAP'92), Berkeley, Aug. 1992. Second, whenever the inner decoder makes an error the errored se- 
quence is li kely to be from a small subset of all possible data sequences espedally at nuxlerate and high signal- 
to-noise ratk)s. Prior approaches make no use of this property to reduce the complexity. See G. Battail, supra; 
J. Hagenauer and P. Hoeher, supra\ J. Huber and Rueppel, supra; J. Hagenauer, P. Hoeher, and J. Huber, supra; 
and O. Jorgensen, M. Vaupel, and H. Meyr, supra. 

Additionally, Sfez and Battail have proposed a method which computes the ML path and the besi path 
among alternatives in "A We^hted-Output Variant of the Viterbi Algorithm for Concatenated Schennes Using 
a Convolutional Inner Code," Proc. EUROCODE'90, Udine, Italy. Nov. 1 990. However, this method has several 
disadvantages: (i) ocmputational efforts grow exponentially with the memory In the inner coding process, which 
implies more complexity and mennory for implementatk>n; (ii) the technique is based on event length rather 
than properties of the code; and (ill) the technique is restricted to Viterbi decoding. Thus, there is a need for 
a nrtethod and apparatus for post-processing to provkle reliability information about decoded data symbols at 
the output of decoders that are efficient and that may be extended beyond Viterbi decoding. 

Summary of the Ifivention 

The present inventton diseases a method and apparatus for post-processing to provide reliability infor- 
35 mation for decoded data symbols at the output of a decoder that avoids many of the disadvantages of prior 
methods. The inventton utilizes a suboptimal implementatton of the optimal symt)ol-by-symbol detection 
(OSSD) method. Instead of taking all possible paths at each time instant Into account as done in the OSSD, 
only one decoded path (which is the maximum likelihood path for an inner Viterbi decoder) and a finite numt>er 
of error paths are computed. Hence, both the amount of computation and storage may be small compared to 
40 piBsent techniques. 

The method and apparatus is first used for an inner decoder that is based on the Viterbi algorithm. The 
method advantageously determines the prot>abilrties of a list of likely alternatives that differ from the decoded 
sequence at least in the symbol for which the reliability information is being computed and uses the most prot>- 
able of these as a basis for computing the reliability. The method and associated apparatus potentially have 

45 a smaller complexity than those using prevtously proposed soft output Viterbi algorithms because, unlike In 
previous techniques the reliability infonmation is computed for all states at each time instant, the reliability In- 
formation is evaluated only for the ML sequence. Second, the method and associated apparatus advanta- 
geously recognize that the functions of likelihood evaluation and dedskin, which are inherently combined in 
the VA, could instead l>e separated. This implies that the post-processor is applicable to any (sut>optlmal hard- 

60 output) detector in applk^ations with a given likelihood functk)n. Finally, the technk|ues m^ be generalized for 
an arbitrary coder. 

Brief Description of the Drawlnfls 

55 Other features arul advantages of the invention will become apparent from the foOowifYg dotal led descrip- 

tion taken together with the drawings in whteh: 

FIG. 1 illustrates a concatenated coding system. 

FIG. 2 illustrates a concatenated coding system with interleaving and deinterleaving. 
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FIG. 3 illustrates a concatenated coding system with a post-processor 
FIG. 4 illustrates the operation of a post-processor. 



Detailed Description 

5 

/. Introduction 

FIG. 3 illustrates an embodiment of the invention in which post-processor 310 is used in a concatenated 
coding system. Post-processor 310 accepts the received sequence r{k) and the output b{ki of inner decoder 

10 308 and generates a signal representing reliability information for use by outer decoder 312 in determining 
a{k). The principles of the invention may be described as follows - instead of constructing an optimal detector 
which combines likelihood evaluation and decision making by the VA, both of these functions can be separated. 
In many applications, it is too expensive to optimize the likelihood function (e.g., if the number of states is ex- 
cessive). But a suboptimum (hard decision) decoder/detector is often implementable. Also the likelihood func- 

15 tton for the given problem is assumed to be known. The hard decisions of the arbitrary decoder/detector are 
fed into a likelihood f unctk>n evaluator. To obtain reliability informatk>n for a particular decoded bit, that bit alone 
is flipped, and the likelihood is evaluated. The ratio of the likelihoods is then the reliability associated with this 
informiation bit More generally, rather than flipping a single information bit alone, we may choose to flip some 
of the other bits too (e.g. neighboring bits) to compute the reliability of that bit 

20 Section if describes the proposed method in detail. Section III presents illustrative embodiments of the 

method in different applications indicative of the broad spectrum of possible applications. 

//. A Method for Post-Processor Reliability Generation 

25 FIG. 4 Illustrates the steps performed by post-processor 310 to generate signals containing reliability in- 

formatk>n for use by outer decoder 312. Assume a communicattons system with binary signaling and alphabet 
±1 . Although binary signaling is assumed, generalization to more than two levels Is straightforward. The MAP 
(maximum a posteriori) detector at time k computes the likelihood or conditional probability 

30 Here {fjj is the received sequence and j takes on values ±1 . The detected symbol is the value with the higher 
probability and is denoted It is assumed that this probability can be computed. See L. R. Bahl, J. Cooke, 
F. Jelinek and J. Raviv, "Optimal Decoding of Linear Codes for Minimizing Symbol Error Probability," IEEE 
Trans. Inf, Theory, vol. IT-20. pp. 284-287, March 1974^ The reliability associated with symbol />/t is 

Since the complexity of this method is high, simplified or suboptlmal approaches are desired. 

An alternative representatton that is amenable to simplificatton is as follows. Let the output of the outer 
code of Figure 1 be the data sequence {t^k)h which is encoded by the inner code to produce the transmitted 
data sequence {s{b,ki}, where k is the time index. The received sequence {r{ki} is {s{b,kff corrupted by the 
^ noise sequence {n{ki}. The noise random variate n^^ is assumed to be an i.i.d. (independent, kjentically distrib- 
uted) zero mean Gaussian variate with probability density f unctton gh^en by 

Pn(n*) = — J— e-'?«<^. 

where is the variance of the Gaussian variate. Then the conditional likelihood of the received sequence con- 
ditioned on {b{ki} is 



so 



55 



P [Mk))\fb(k))] = JJPnlriky-'sib.kn 



Let Sf (k) be the set of all sequences of fl}(k)} for which the data estimate at time /c is + 1 . and let S-(ki be the 
set of all sequences of {b(kj} for which the data estimate at time is - 1 . Let the oonresponding sequence prob- 
abilities be P(£h) and P(b-), respectively. Then, the likelihood functk>aof the OSSD under the hypothesis of a 
•fl was transmitted is gh^en by 

where K is an arbitrary positive constant which is the same for all bits. OSSD decisk)n requires the computation 
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of all path probabilities. This may be done recursively and requires block-processing, estimating of the noise 
variance o^, and avoidance of numerical problems. See J. Hagenauer, P. Hoeher, and J. Huber, supra. 

A first step towards simplification of OSSD is as follows: let the maximum likelihood estimate of the data 
sequence, which can be found efficiently by the Viterbi algorithm, be denoted by 



(kk)} = arg max p [{ra)}\{bik)}]. 



(where arg max denotes the argument, i.e. that data sequence, which minimizes the probability) and let the 
conditional probability associated with the ML decoded data sequence be P{b), Consider a sequence {d(k)} 
that differs from {b{ki} in bit position k. In the presence of additive white Gaussian noise, this probability is 
given by p({r{k)} I {d{ki}). Among all such sequences {d{k)}, only the one with the highest probability is chosen. 
Let this sequence be {d*{k)} and let the associated a posteriori probability be P(tf*). Then, the likelihood func- 
tion reduces to 

This task of generating an alternative hypothesis for the decoded symbol is done at each time instant, and the 
reliability for that symbol is evaluated. However, the list of alternath^es to be considered grows exponentially 
in the length of the data sequence {b{ki}, A second simplification is to consider only the nearest neighbor al- 
ternatives or the nearest neighbors and the neighbors at the next smallest distance, etc. The number of nearest 
neighbors and the exact sequence structure can be derived one the inner encoding process is specified. Let 
there be N nearest neighbors. For each neighboring sequence d(/0 we compute the a a posteriori probability 
P(cO and choose the one with the largest probability. This prot>ability now approximates P(</*). Obviously the 
larger the number of alternatives, the better Is the quality of the soft informatk>n at the cost of increase in com- 
putational complexity. Note that the performance of the OSSD cannot be approached as long as only one path 
Is considered in the numerator (because of the prior decision) and In the denominator, respectively. However, 
the generalization is straightforward by taking multiple paths Into account and applying the high-SNR rule. See 
J. Hagenauer, P. Hoeher, and J. Huber, supra. 

In some applications, especially In time-varying situations, the distance properties of the inner code are 
not given a-priori, such as for time-varying iSI channels, ft could be too time-consuming to compute this dis- 
tance property. Then, a further simplif teatton is to consider the ^ alternatives that differ only within a finite 
window from instant k-D to k^D. Let the output of an arbitrary inner decoder be 6(/^. Let the associated a pos- 
teriori probability be P{b). For each alternative sequence d(A), d^ermlne the a posteriori probability 

p{m}\{dm 

and choose the largest one. Let it be {k) and let the associated a posteriori probability be P{d*). The likeli- 
hood at time k, Le. the reliability value of the bit Is 

As an example, let us assume that the single informatton bit is the most 11 kely error, and if D = 0, the error table 
consists of only one entry, namely that sequence which differs from the decoded sequence at time it and is 
the same everywhere else. 

///. Applhations 

Overview 

Examples A and B consider concatenated coding systenrrs consisting of an outer parity check code and 
an inner code, which Is a binary Intersymbd Interference channel with a memory of two channel symbols and 
a memory two rate f? = 1/2 convolutional code, respectively. The fiist stage of the Inner decoder is a Viterbi 
decoder with four states for both examples. Without reliability infonmatton from the inner decoder, the outer 
decoder can only perform error detectk>n. in the presence of rellabilfty informatton, however, Wagner decoding 
can be performed to obtain a 1-2 dB gain for the two examples. The third example considera a coded syn- 
chronous DS-CDMA system with a zero-forcing multiuser detector (Mecorrelation detector^. A combined like- 
iihxperimentsood evaluation and deciston, e.g. by means of the (SO)VA, is not applicable for K= 32 users. 
Therefore, the outputs of the deoonnelatbn detector are post-processed whk:h can be implemented with linear 
effort in K. 
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Example A - Inner ISI Channel and Outer Parity Check Code 

Consider the example of an outer code consisting of a single parity bit added to 8 information bits. The 
output of the outer code is interleaved and antlpodally transmitted as + 1 or - 1 over an ISI channel. The ISI 
channel impulse response is h{Q)= 0.26, /j(1)=0.93, and /K2)=0.26. The noisy receded data is decoded by a 
4-state Werbi decoder perfbnming maximum likelihood sequence estimation. As described in J.G. Proakis, 
Digital Communications, McGraw-Hill, 2nd ed.. 1 989. Reliability infomration is generated by considering error 
sequences which result in the smallest and the next to smallest Euclidean distances. There are 4 such error 
patterns. These are 



0,. 



(1) 





= 0. 


0... 


..0. 


e(0) = 2, 




= 0. 


0... 


.,0. 


e(0)=2. 




= 0. 


0.... 


.0. 


e(0)=2. 




= 0. 


0^., 


.0, 


e(0) = 2, 



Azero in the enror vector indicates no ennor. while a 2 indicates that + 1 is decoded as - 1. Similarly -2 indicates 
that-.1 is decoded as -i- 1. 

The enror patterns should be added or subtracted from the decoded sequence depending on the sign of 
the decoded data symbol for which the reliability is being computed. Without loss of generality let it be a*(/0. 

25 If the sign of the decoded symbol is negative (positive), then the errorsequence should be added (subtracted) 
to the decoded data sequence. Also, the error pattern is listed in such a way that the enror symbol e(0) should 
be added to or subtracted from a*(/0.e(1) to a*(/f+1). etc. Further, a valid error pattern for consideration is the 
one which when added or subtracted yields a legitimate alternative information sequence. For example if the 
decoded data symbols in a window centered around a*{k) are all - 1, then the only error sequence from the 

30 Short list in (1), that yields a legitimate alternative information sequence is {e(i);. In general, two types of error 
events should be considered. The first one is where the error event starts at time k. The second one is where 
the enror event started at an earlier instant and has not terminated at time k and furthermore an error occurs 
at time k. Only the fonmer requires^ new probability evaluations, since the probabilities corresponding to the 
latter situation would have been evaluated before. 

35 After deinterleaving both the decoded sequence and the corresponding soft information sequence, the 

parity is computed every 9 bits. If the parity is incorre<t then the bit with the least reliability is flipped. 

Example B - Inner Convoluthnal Code and Outer Parity Check Code 

40 This example considers a rate /? = 11/12 parity check outer code and a rate R = 1/2 inner convdutional 

code. The overall rate of the concatenated code is /? = 1 1 /24. The convdutional code has memory Af = 2 with 
free dfetance df^ =5. The total number of incorrect neighbors at distance cf is denoted a^ ai=a^Q^=0, a6=1 . 
36=2, 87=4, etc For each neighbor at a distance d, there are infonmation bits in enror. Ci=Ci=^=C4=cfe=1 , 
^"^f <>7=12, etc. The soft outputs were produced with an error table consisting of error patterns with Hamming 

45 weight cN5, 6, and 7. At any given time k, seven (85+86+87=7) new alternatives need to be evaluated. (This is 
the number of list elements actually to be stored.) However, in order to account also for error events starting 
at earlier instants, one needs to conskJer all seventeen (05+0^+07=17) alternatives. 

Paranneter In this figure is the number of alternatives in the error table. When the list size is = 1, only 
the Hamming distance 5 event is considered. When the list size is Cb+c^ = 5, all events up to distance 6 are 

50 considered, and when the list size is Cfe+c^+o^ = 17, all events up to distance 7 are considered. 

Example C - Coded DS-CDMA System with ZF Multiuser Detector and Ukelihood Po^-Processor 

This last example demonstrates that the post-processor is not only applicable to obtain reliability informa- 
65 tion in combination with a Viterbi decoder, but can be nrrore generally used to obtain reliability information given 
hard decisions of any (including suboptinrwm) decoder/detector, if a likelihood function can be formulated for 
this problem. This also leads to a new dass of suboptimum decoder/detectors. 

The particular example considers coded synchronous DS-CDMA system. The optimum multiuser detector 
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delivering symbol reliability Information is an OSSD; seeS. Verdu. "Minimum Probability of Eirorfor Asynchron- 
ous Gaussian Multiple-Access Cliannels," IEEE Trans. Inform. Theory, vol. IT-32. pp. 85-96, Jan. 1986. The 
complexity of this detector, however. Increases exponentially in the number of users, K, and hence is imprac- 
tical even for nrK>derate K. The zero-forcing (ZF) multiuser detector fdecorrelatton detector^ belongs to the 

5 class of linear multiuser detectors, with a complexity which Is only linear in K. This detector is easily to imple- 
ment when the signature sequence is known. However, since this detector inverts the channel (analog to a 
zero-forcing equalizer inverting an ISI channel), the outputs do not contain valuable reliability information, e.g. 
large amplitudes do not necessarily represent reliable decisions. Therefore, this embodiment illustrates a post- 
processor following the zero-forcing multiuser detector or any other multiuser detector. 

10 The basic method to obtain reliability information from any (hard decision) detector for a problem with a 

given likelihood function is to substitute hard decisions into the likelihood function, and to flip successively 
only a single information bit given the remaining decisions are fixed. This method can easily t>e extended by 
flipping all permutations with two infonmation bits, three information bits, etc., or to evaluate the most likely 
error events. Thus, in the limit the optimum detector is approached. 

IS Consider a coded synchronous DS-CDMA system with K = 32 active users. The signature sequences are 

fixed consecutive chunks of length A/ = 64 of a 2^2 1 PN sequence. The encoder is a rate 1/2 convolutional 
code with memory Af = 2, i.e. four states, and the corresponding decoder is a soft-decision Viterbi decoder 
with 32 symbols delay. The encoded bits are spread by a (6,A^(64,24) convolutional interleaver to (almost 
completely) randomize error bursts in the receiver. The transmission format is binary antipodal signaling. Each 

20 user is transmitting over a Rayleigh fading channel with a normalized Doppler frequency of 0.01. These chan- 
nels are mutually independent, and are assumed to be perfectly tracked by the receh^er. 

Finally, a class of new suboptimum decoder/detectors, e.g. multiuser detectors, can be designed. The idea 
is to run any decoder/detector with a following post-decision unit, to select the, let say k, least reliable bit de- 
cisk>ns, and to run finally an optimum (post) decoder/detector for only these k information bits given the re- 

25 maining decisions to be fixed. Hence, the complexity of the post decoder is only exponential in k instead of in 
K, 



Claims 

30 

1 . A method for generating a signal comprising reliability information in a decoding system wherein said de- 
coding system comprises a first decoder, wherein said first decoder decodes a received sig nal to generate 
a first signal, sakJ method corhprising the steps of: 

determining a likelihood function representing the likelihood of the received signal gh^en the first 
35 signal, ^ 

selecting a set of nearest neighbor to said first signal; determining a set of AO^^L, likelihood func- 
tions representing the likelihood of the received sequence given the set of nearest neighbors; 
selecting the nearest neighbor / with the greatest likelihood; 

generating a signal representing a reliability value for the k*** bit in said first signal wherein said 
40 reliability value is a function of said received signal, said first signal and said nearest neight>or. 

2. The method of daim 1 wherein said first signal is a maxinfujm likelihood sequence estimate generated 
by a Viterbi decoder. 

^ .3. The method of daim 1 wherein said reliability signal is input to a second decoder. 

4. The method of daim 1 wherein sakj set of nearest neighbors is generated from knowledge of a code and 
the distance properties of said code wherein said code was used to encode said received signal. 

5. The method of daim 1 wherein said set of nearest neighbors is generated by selecting a permutation of 
^ bit values for bits within a window around said Hh bit 

6. A system for generating a signal comprising reliability informatkm in a decoding system wherein sakj de- 
coding system comprises a first decoder, wherein said first decode decodes a received signal to generate 
a first signal, sakj system comprising: 

^ means for determining a likelihood function representing the likelihood of the received signal given 

the first signal, 

means for selecting a set of nearest neighbor to said first signal; 
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means for determining a set of /.O^/^, likelihood functions representing the likelihood of the re- 
ceived sequence given the set of nearest neighbors; 

means for selecting the nearest neighlxw / with the greatest likelihood; 

means for generating a signal representing a reliability value for the 1^^ bit in said first signal wherein 
sakJ reliability value is a function of said received signal, said first signal and said nearest neighbor. 



8 



EP 0 625 829 A2 



a(l<) 



121 



OUTER 
ENCODCR 



b(k) 



123 



INNER 
ENCODER 



FIG. 1 

(PRIOR ART) 



n(k) 



s{b,k) 



124 



r(k) 



125 



INNER 
DECODER 



b(k) 



127 



OUTER 
DECODER 



o{k) 



FIG, 2 

(PRIOR ART) 



OUTER 
ENCODER 






OUTER 
ENCODER 





INTERLEAVER 



222 



226 

4- 



DONTERLEAVER 





INNER 
ENCODER 


f 




INNER 
DECODER 



n(k) 



FIG. 3 



a(k) 



302 

-J- 

OUTER 
ENCODER 



b(k) 



304 

INNER 
ENCODER 



Kk) 



308 

-4- 

INNER 
DECODER 



b(k) 



310^- POSTPROCESSOR 



OUTER 
DECODER 



oik) 



REUABIUTY 
INFORMATION 



NSOOaO: <EP_062Se29A2J^ 



EP 0 625 829 A2 



FIG. 4 




RECEIVE INPUT }r|(| AND OUTPUT |b|(| 
SIGNALS OF INNER DECODER 



DETERMINE UKEUHOOD 

wmm) 



GENERATE UST OF N NEAREST NEIGHBORS 
|di(k}| OF OUTPUT SIGNAL OF 
INNER DECODER. i=I.N 



DETERMINE UKEUHOOD OF INPUT SIGNAL 
GIVEN EACH NEAREST NEIGHBOR 
P(|r(k){|jdi(k)|) 



SELEa NEAREST NEIGHBOR WITH 
UR6EST PROBABIUTY, d*(k) 



• EVALUATE RELIABIH VALUE FOR BIT k 
L.- P(|r(lc)l|{b(k){) 
P(ir(k)j||d»(k)j) 



GENERATE SIGNAL COMPRISING INFORMATION 
ABOUT REUABIUTY VALUE 




10 



.062Sa29A2_l_> 



iiliillliliiiililillli 

(11) EP 0 625 829 A3 

(12) EUROPEAN PATENT APPLICATION 



(88) 


Date of publicatfon A3: 


(51) lntCI.6: H03M 13/00 




20.08.1997 Bulletin 1997/34 


(43) 


Date of publication A2: 






23.11.1994 Bulletin 1994/47 




(21) 


Application number: 94303374.6 




(22) 


Date of filing: 11.05.1994 




(84) 


Designated Contracting States: 


• Seshadrl, Nambirajan 




DE ES GB IT NL 


Chatham, New Jersey 07928 (US) 


(30) 


Priority: 21.05.1993 US 65296 


(74) Representative: 






Watts, Christopher Malcolm Kelway, Dr. et al 


(71) 


Applicant: AT&T Corp. 


Lucent Technologies (UK) Ltd, 




New York, NY 10013-2412 (US) 


5 Mornlngton Road 






Woodford Green Essex, IG8 OTU (GB) 


(72) 


Inventors: 


• 


Hoeher, Peter 






D-82211 Herrechlng (DE) 





(54) Post processing method and apparatus symbol reliability generation 




EuropSlsches Patentamt 
European Patent Office 
Office europeen des brevets 



(57) A method is disclosed for a post-processor for 
providing reliability information about every decoded da- 
ta symbol at the output of an arbitrary decoder. This re- 
liability infomr^tion Is generated by comparing the de- 
coded sequence to a small list of altematrve sequences 
which differ from the decoded sequence at least in the 
symbol for which the reliability is being evaluated. It is 
shown that this algorithm is a simplification of the opti- 
mal symbol-by-symbol detector (OSSD), 



FIG, 



mm mn irij and output ]b\i 
SfGNAlS Of fum oecooER 



OHERUtNC UKQIHOGD 



CO 

< 

CM 

00 

lO 
CM 



Q. 
LU 



GENERATE UST OF N KCAREST tfmaOOS 

}d<(k)| OF OUtPUr SR^UL OF 
WKER OECOOER. i=ljf 



OETEfiMlNE UKEUHOQO OF INPUT SIGNAL 
OVEN EACH NEAREST NEIGHBOR 



SEUa NEAi^ NEIGHeOR WTH 
UBGEST fflOBABOm, <r(k) 



EVALUATE REUA9TY VAU£ mmk 



GENERATE SiGNAl COUPRISING MFORIlUIION 
ABOUT ROJABUTY VAU£ 



Printed by JotMO. 76001 nVRIS(Fn) 



^SOOCID: <£P_0626e29A3_l^ 



EP 0 625 829 A3 



European PaCcnt 
Office 



EUROPEAN SEARCH REPORT 



EP 94 30 3374 



DOCUMENTS CONSIDERED TO BE RELEVANT 



Ck«tioa of document whh indicsti«ii, where appropriate, 
of retevant passageg 



EP 0 434 040 A (MITSUBISHI) 

* page 4. column 5, line 4 - page 5, 
column 8, line 57; figures * 

EP 0 233 788 A (SONY) 

* page 6. line 6 - page 17, line 27; 
figures * 

GB 2 253 123 A (ERICSSON) 

* page 4. Vine 1 - page 11, line 35; 
figures * 



Tbc present searcfa report has been drawn up for all dabns 



Relevant 
to cUim 



.2,6 



1.2.6 



1.6 



CLASSIHCATION OF THE 
APPUCATION (lnt.CL5) 



H03M13/00 



TECHNICAL FIELDS 
SEARCHED (iiit.CL5) 



H03M 



THE HAGUE 



Dite mt mmMkm at iht wtank 

25 June 1997 



Geoghegan, C 



o 



CATEGORY OF CITED DOCUMENTS 

X : partladarly rdevaac tf taken aloac 

Y : partiaiUrty rdcvaot If comUaei wfth another 

4ocui»cst of the fame cafeRonr 
A : technolocieal backcnnta4 
O : noQ-writlcM lisdontre 
P : iniennediatc 4oc«mcat 



T : cheoiy or principle nadcrUing the {ovndoo 
E : carilcr patcat dacBUMnt, but pabtisbe4 on« or 

tftcr the fUi^ date 
D : 4ocuincat dtcd la the application 
L: docamat dtod fo- otticr reasons 

diTncfahcr of the same patent fimUy, cotrcsponding 
document 



2 



tNSOOCIO: <EP_062S829A3J_> 



